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Abstract 

The prediction properties of Aitken's iterated A 2 process, Wynn's epsilon algorithm, and 
Brezinski's iterated theta algorithm for (formal) power series are analyzed. As a first step, 
the defining recursive schemes of these transformations are suitably rearranged in order to 
permit the derivation of accuracy-through-order relationships. On the basis of these rela- 
tionships, the rational approximants can be rewritten as a partial sum plus an appropriate 
transformation term. A Taylor expansion of such a transformation term, which is a ra- 
tional function and which can be computed recursively, produces the predictions for those 
coefficients of the (formal) power series which were not used for the computation of the 
corresponding rational approximant. 

1 Introduction 

In applied mathematics and in theoretical physics, Pade approximants are now used almost 
routinely to overcome problems with slowly convergent or divergent power series. Of course, 
there is an extensive literature on Pade approximants: In addition to countless articles, there 
are several textbooks §,|,||,0,||,|4l|,|4|,|5|,|7|, review articles collections 



of articles and proceedings ^,P,^MMP,|^,^^,[fl, P^ , [ill , bibliographies (T|,|^,|TT5] 



and there is even a book |19| and an article [ ]22| , respectively, treating the history of Pade 
approximants and related topics. A long but by no means complete list of applications of Pade 
approximants in physics and chemistry can be found in Section 4 of |100|| . 
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The revival of the interest in Pade approximants was initiated by two articles by Shanks 



and Wynn |116| , respectively. These articles, which stimulated an enormous amount of research, 
were published in 1956 at a time when electronic computers started to become more widely avail- 



able. Shanks [84] introduced a sequence transformation which produces Pade approximants if 



the input data are the partial sums of a power series, and Wynn [116] showed that this trans- 
formation can be computed conveniently and effectively by a recursive scheme now commonly 
called the epsilon algorithm. As a consequence of the intense research initiated by Shanks |84| 
and Wynn |116| ] , the mathematical properties of Pade approximants are now fairly well under- 
stood, and it is generally accepted that Pade approximants are extremely useful numerical tools 
which can be applied profitably in a large variety of circumstances. 

This intense research of course also showed that Pade approximants have certain limitations 
and shortcomings. For example, Pade approximants are in principle limited to convergent and 
divergent power series and cannot help in the case of many other slowly convergent sequences 
and series with different convergence types. 

The convergence type of numerous practically important sequences {s n }^ =0 can be classified 
by the asymptotic condition 



lim 

n— »oo 



Sn+l 



(1.1) 



which closely resembles the well known ratio test for infinite series. Here, s = Sqo is the limit 
of {s n }™ =0 as n 



oo. 



A convergent sequence satisfying ( |1.1| ) with \p\ < 1 is called linearly 
convergent, and it is called logarithmically convergent if p = 1. The partial sums of a power series 
with a nonzero, but finite radius of convergence are a typical example of a linearly convergent 
sequence. The partial sums of the Dirichlet series for the Riemann zeta function, 



Re(z) > 1 



(1.2) 



m=0 



which is notorious for its extremely slow convergence if Re(z) is only slightly larger than one, 
are a typical example of a logarithmically convergent sequence. 



Pade approximants as well as the closely related epsilon algorithm 1 1 16 1 are known to ac- 
celerate effectively the convergence of linearly convergent power series and they are also able 
to sum many divergent power series. However, they fail completely in the case of logarithmic 
convergence (compare for example |117| , Theorem 12]). Moreover, in the case of divergent power 
series whose series coefficients grow more strongly than factorially, Pade approximants either 
converge too slowly to be numerically useful [35|, 86| or are not at all able to accomplish a sum- 
mation to a unique finite generalized limit [|54j[ . Consequently, the articles by Shanks [84| and 



Wynn [11C] also stimulated research on sequence transformations. The rapid progress in this 
field is convincingly demonstrated by the large number of monographs and review articles on 
sequence transformations which appeared in recent years II, P, p^, [26l, p|, |67|, gg, n H EDI • 

In some, but by no means in all cases, sequence transformations are able to do better 
than Pade approximants, and it may even happen that they clearly outperform Pade approx- 
imants. Thus, it may well be worth while to investigate whether it is possible to use instead 
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of Pade approximants more specialized sequence transformations which may be better adapted 
to the problem under consideration. For example, the present author used sequence transfor- 
mations successfully as computational tools in such diverse fields as the evaluation of special 

, 100| , 103 , 106 ], the evaluation of molecular multicenter integrals of expo- 



functions nS3U9GLB5,96 



nentially decaying functions (5£ , 61, 10C , 109, 111] , the summation of strongly divergent quantum 
mechanical perturbation expansions 

||HBMii'|0M^'ll0l-|l0l ; and the extrapolation 
of quantum chemical ah initio calculations for oligomers to the infinite chain limit of quasi- 
onedimensional stereoregular polymers 32 , 10C , 11C |. In vast majority of these applications, it 
was either not possible to use Pade approximants at all, or alternative sequence transformations 
did a better job. 

In most practical applications of Pade approximants or also of sequence transformations, the 
partial sums of (formal) power series are transformed into rational approximants with the inten- 
tion of either accelerating convergence or to accomplish a summation to a finite (generalized) 
limit in the case of divergence. Pade approximants and sequence transformations are normally 
not used for the computation of the coefficients of the power series. In the majority of applica- 
tions, the computation of the coefficients of power series is not the most serious computational 
problem, and conventional methods for the computation of the coefficients usually suffice. 

However, in the case of certain perturbation expansions as they for instance occur in high 
energy physics, in quantum field theory, or in quantum chromodynamics, the computational 
problems can be much more severe. Not only do these perturbation expansions, which are power 
series in some coupling constant, diverge quite strongly for every nonzero value of the coupling 
constant, but it is also extremely difficult to compute more than just a few of the perturbation 
series coefficients. Moreover, due to the the complexity of the computations and the necessity 
of making often drastic approximations, the perturbation series coefficients obtained in this way 
are usually affected by comparatively large relative errors. Under such adverse circumstances, it 
has recently become customary to use Pade approximants to make predictions about the leading 
unknown coefficients of perturbation expansions as well as to make consistency checks for the 
previously calculated coefficients p7, 30, 31, 4€-5C,p5, 79-83|, 

On a heuristic level, the prediction capability of Pade approximants, which was apparently 
first used by Gilewicz [^TJ, can be explained quite easily. Let us assume that a function / 
possesses the following (formal) power series, 



/(*) = 



u=0 



and that we want to transform the sequence of its partial sums 



fn(z) = ^luZ V 



(1.3) 



(1.4) 



u=0 



into a doubly indexed sequence of Pade approximants 



[l/m] f (z) = Pi{z)/Q m {z) 



(1.5) 
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As is well known |||8]], the coefficients of the polynomials Pi(z) = po + p\z + . . . + piz 1 and 
Qm(z) = 1 + qiz + . . . + qmZ m are chosen in such a way that the Taylor expansion of the Pade 



approximant agrees as far as possible with the (formal) power series (1.3): 

f(z) - Pi{z)/Q m {z) = 0(z l+m+1 ) , z^O. (1.6) 

This accuracy-through- order relationship implies that the Pade approximant to f(z) can be 
written as the partial sum, from which it was constructed, plus a term which was generated by 
the transformation of the partial sum to the rational approximant: 

l+m 

[l/m] f (z) = Y,lvZ v + z l+m+1 vr(z) = h +m {z) + z l+m+1 Vr{z). (1.7) 
Similarly, the (formal) power series ( |1.3| ) can be expressed as follows: 

l+m 

/(*) = £ 7l/ z" + z l+m+1 F l+m+l {z) = f l+m {z) + z l+m+1 T l+m+l {z) . (1.8) 

Let us now assume that the Pade approximant [l/m]f(z) provides a sufficiently accurate 
approximation to f(z). Then, the Pade transformation term Vf l {z) must also provide a suffi- 
ciently accurate approximation to the truncation error ,F/ +jn+ i(z) of the (formal) power series. 
In general, we have no reason to assume that VJ n (z) could be equal to J : i +m+ i(z) for finite val- 
ues of / and m. Consequently, Taylor expansions of V^ijz) and ^ +m+ i(2;), respectively, will in 
general produce different results. Nevertheless, the leading coefficients of the Taylor expansion 
for Vp(z) should provide sufficiently accurate approximations to the corresponding coefficients 
of the Taylor series for JF i+m+1 (z). 

It is important to note that this prediction capability does not depend on the convergence 
of the power series expansions for V™{z) and Ti+ m +i(z), respectively. Pade approximants are 
able to make predictions about series coefficients even if the power series (|1.3|) for / as well as 
the power series expansions for VY 1 and Ti+ m +\{z) are only asymptotic as z — > 0. This fact 
explains why the prediction capability of Pade approximants can be so very useful in the case 
of violently divergent perturbation expansions. 

Let us now assume that a sequence transformation also produces a convergent sequence of 
rational approximants if it acts on the partial sums ( |1.4| ) of the (formal) power series ( |1.3[ ). Then, 
by the same line of reasoning, these rational approximants should also be able to make predictions 
about the leading coefficients of the power series, which were not used for the construction of the 
rational approximant. It seems that these ideas were first formulated by Sidi and Levin |^] and 



Brezinski [18|. Recently, these ideas were extended by Prevost and Vekemans [72] who discussed 
prediction methods for sequences which they called e p and partial Pade prediction, respectively. 
Moreover, in |105(| it was shown that suitably chosen sequence transformations can indeed make 
more accurate predictions about unknown power series coefficients than Pade approximants. 

Consequently, it should be interesting to analyze the prediction properties of sequence trans- 
formations. In this this article, only Aitken's iterated A 2 algorithm, Wynn's epsilon algorithm 



Prediction Properties of Sequence Transformations 



5 



and the iteration of Brezinski's theta algorithm will be considered. Further studies on the 
prediction properties of other sequence transformations are in progress and will be presented 
elsewhere. 

If the prediction properties of sequence transformations are to be studied, there is an addi- 
tional complication which is absent in the case of Pade approximants. The accuracy-through- 
order relationship ( |1.6[ ) leads to a system of I + m + 1 linear equations for the coefficients of 
the polynomials Pi(z) = po + P\z + . . . + piz 1 and Q m (z) = 1 + q\z + . . . + q m z m of the Pade 
approximant ( |1.5| ) ||||]. If this system of equations has a solution, then it is automatically guar- 
anteed that the Pade approximant obtained in this way satisfies the accuracy-through-order 
relationship Ql.G|). 

In the case of the sequence transformations considered in this article, the situation is in 
general more complicated. These transformations are not defined as solutions of systems of 
linear equations, but via nonlinear recursive schemes. Moreover, their accuracy-through-order 
relationships are with the exception of Wynn's epsilon algorithm unknown and have to be derived 
via their defining recursive schemes. 

On the basis of these accuracy-through-order relationships, it is possible to construct explicit 
recursive schemes for the transformation errors as well as for the first coefficient of the power 
series which was not used for the computation of the rational approximant. 

In Section the the accuracy-through-order and prediction properties of Aitken's iterated 
A 2 process are analyzed. In Section |3|, the analogous properties of Wynn's epsilon algorithm 
are discussed, and in Section ||, Brezinski's iterated theta algorithm is treated. In Section ||, 
some applications of the new results are presented. This article is concluded by Section || which 
contains a short summary. 



2 Aitken's Iterated A 2 Process 

Let us consider the following model sequence: 

s n = s + cA", |A|^1, n G No . (2.1) 

For n — > oo, this sequence obviously converges to its limit s if < |A| < 1, and it diverges away 
from its generalized limit s if |A| > 1. 

A sequence transformation, which is able to determine the (generalized) limit s of the model 
sequence ( |2.1| ) from the numerical values of three consecutive sequence elements s n , s n +\ and 
s n+ 2, can be constructed quite easily. Just consider s, c, and A as unknowns of the linear system 
s n +j = s + c\ n+3 with j = 0, 1, 2. A short calculation shows that 

4-) = Sn - 1^1!, n S No, (2.2) 

is able to determine the (generalized) limit of the model sequence fl2,l| ) according to A^f* = s. 
It should be noted that s can be determined in this way, no matter whether the sequence ( |2.1| ) 
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converges or diverges. The forward difference operator A in (2.2) is denned by its action on a 
function g = g(n): 



A#(n) = g(n + 1) - g{n) . 



(2.3) 



is certainly one of the oldest sequence transformations. It is usually 

91] mentioned 



The A 2 formula ( g? 
attributed to Aitken Q, but it is actually much older. Brezinski [19, pp. 90 
that in 1674 Seki Kowa, the probably most famous Japanese mathematician of that period, 
tried to obtain better approximations to tt with the help of this A 2 formula, and according to 
Todd [91, p. 5] it was in principle already known to Kummer [66]. 

There is an extensive literature on Aitken's A 2 process. For example, it was discussed 
by Lubkin @, Shanks @, Tucker H,|j§, Clark > Gra y' and Adams f37|, Cordellier f3§, 
Jurkat p4|, Bell and Phillips [10|, and Weniger [95, Section 5]. A multidimensional generalization 



of Aitken's transformation to vector sequences was discussed by MacLeod [69]. Modifications 
and generalizations of Aitken's A 2 process were proposed by Drummond [45], Jamieson and 
O'Beirne |6^1 , Bj0rstad, Dahlquist, and Grosse Jl2j, and Sablonniere [76|. Then, there is a close 



connection between the Aitken process and Fibonacci numbers, as discussed by McCabe and 
Phillips [fn|] and Arai, Okamoto, and Kametaka HJ. The properties of Aitken's A 2 process are 
also discussed in books by Baker and Graves-Morris 
Zaglia 




, Brezinski [15,16|, Brezinski and Redivo 



Delahaye J43j, Walz |9J, and Wimp flm 
The power of Aitken's A 2 process is of course limited since it is designed to eliminate only 
a single exponential term. However, its power can be increased considerably by iterating it, 
yielding the following nonlinear recursive scheme: 



A 



(n) 



n <E M 



o ■ 



A 



(n) 
k+1 



A 



(») 



[A4 n) ] 2 

A 2 4 n) 
l(n) 



k, n G N ■ 



(2.4a) 
(2.4b) 



In the case of doubly indexed quantities like Al , it will always be assumed that the difference 
operator A only acts on the superscript n but not on the subscript k: 

AAP = 4" +1) - 4 n) . (2.5) 

The numerical performance of Aitken's iterated A 2 process was studied in [^,95]. Concern- 
ing the theoretical properties of Aitken's iterated A 2 process, very little seems to be known. 
Hillion [pQ] was able to find a model sequence for which the iterated A 2 process is exact. He also 



derived a determinantal representation for Au^. However, Hillion's expressions for Ai 

explicitly the lower order transforms A^\ ■ ■ ■ , Af?\, ■ ■ ■ , A^ +k \ . . . , A^^\ Consequently, it 
seems that Hillion's result pi - although interesting from a formal point of view - cannot help 



l(n) 



contain 



much to analyze the prediction properties of Aif 1 ■ 

If we want to use Aitken's iterated A 2 process for the prediction of unknown series coefficients, 
we first have to derive its accuracy-through-order relationship of the type of ( |1.6|) on the basis 
of the recursive scheme (2.4). 
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It is a direct consequence of the recursive scheme ( |2.4| ) that 2k + 1 sequence elements s n , 
s n+ i, . . . , s n+ 2k are needed for the computation of A^K Thus, we now choose as input data 
the partial sums Ql.4| ) of the (formal) power series ( |Q| ) according to s n = f n (z), and conjecture 

that all coefficients 70, 7i, • • • , 7n+2fc, which were used for the construction of A^\ are exactly 
reproduced by a Taylor expansion. This means that we have to look for an accuracy-through- 
order relationship of the following kind: 

f(z) - Af ] = 0{z n+2k+l ) , z^O. (2.6) 
Such an accuracy-through-order relationship would imply that A^ can be expressed as follows: 
4 n) = fn + 2k(z) + 4 n) * n+2k+l + 0(z n+2k+2 ) , * - . (2.7) 

(n) 

The constant G k is the prediction made for the coefficient 7 n +2fe+l) which is the first coefficient 
of the power series ( |1.3| ) not used for the computation of A^ . 



Unfortunately, the recursive scheme (2.4) is not suited for our purposes. This can be shown 
by computing A± from the partial sums f n {z), f n +i{z), and f n+ 2{z)\ 

r "1 2 n+i 

4 n) = Uz) + [7 " +lJ - • (2.8) 

7n+l - ln+2Z 

Superficially, it looks as if A± is not of the type of ( p.7[ ). However, the rational expression on 
the right-hand side contains the missing terms 7n+i^ n+1 and 7^+2 z n+2 . We only have to use 
1/(1 — y) = l + y + y 2 / (1 — y) with y = ^ n+ 2z/^ n +i to obtain an equivalent expression with the 
desired features: 

4"' = W*) + [7 " +2lV+3 ■ 

7 n+ l - J n+2 Z 

Thus, an expression, which is in agreement with ([2.7|), can be obtained easily in the case of 
the simplest transform A^ . Moreover, ( [2.9D makes the prediction = [7n+2] 2 hn+i for the 
first series coefficient 7 n +3 not used for the computation of A^\ Of course, by expanding the 



denominator on the right-hand side of ( |2.9| ) further predictions on series coefficients with higher 
indices can be made. 

In the case of more complicated transforms A^ with k > 1, it is by no means obvious 
whether and how the necessary manipulations, which would transform an expression of the type 



of (2^) into an expression of the type of ( |2.9| ), can be done. Consequently, it is advantageous 



to replace the recursive scheme ( |2.4D by an alternative recursive scheme, which directly leads to 
appropriate expressions for with k > 1. 

Many different expressions for A^ in terms of s n , s n +i, and s n +2 are known Section 
5.1]. These expressions are all mathematically equivalent although their numerical properties 
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is H Eq. (5.1-7)] 



may differ. Comparison with ( |2.9| ) shows that the for our purposes appropriate expression 

(2.10) 



(n) 



Sn+2 



A 2 t 



Just like (2.2), this expression can be iterated and yields 



A 



(n) 



n e N 



: 



A 



(n) 
k+1 



A 



(n+2) 



[AA : 



(n+l)i2 



A 2 A 



(n) 



/c,n G N 



(2.11a) 
(2.11b) 



The recursive schemes (2^) and ( 2.1l|) are mathematically completely equivalent. However, for 
our purposes - the analysis of the prediction properties of Aitken's iterated A 2 process in the 
case of power series - the recursive scheme ( 2.11 ) is much better suited. 

Next, we rewrite the partial sums (1.4) of the (formal) power series (|1.3|) according to 



fn(z) = f(z) ~ ^n+u+l 



n+u+1 



(2.12) 



u=0 



and use them as input data in the recursive scheme ( |2.11[) . This yields the following expression: 



A 



k,n G N • 



(2.13) 



The quantities R^\z) can be computed with the help of the following recursive scheme which 
is a direct consequence of the recursive scheme ( |2.11| ) for : 



4%) = 



v=0 



fn(z) ~ f(z) 



?n+l 



n G N 



o • 



K n+1) (^)] L 



k,n G 



n . 



In ( p. 14 ), we use the shorthand notation 

5xi n \z) - ^ {n+1) 



5 2 X ( u\z) 



z5X^ +1) 

2xr(n+2), 



(«), 



(z) - 6Xr(z) 
>+l). 



^rw - 2zxr L, (z) + x k 



(n), 



(2.14a) 
(2.14b) 

(2.15a) 
(2.15b) 



It seems that we have now accomplished our aim since ( p,13| ) has the right structure to serve 
as an accuracy-through-order relationship for Aitken's iterated A 2 process. Unfortunately, this 
conclusion is in general premature and we have to require that the input data satisfy some 
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additional conditions. One must not forget that Aitken's A 2 formula (2.10) as well as its 
iteration ( 2.11| ) cannot be applied to arbitrary input data. One obvious potential complication, 



which has to be excluded, is that ( |2.11b| ) becomes undefined if A 2 Aj™ = 0. Thus, if we want to 
transform the partial sums ( |1.4|) of the (formal) power series ( L3 ) , it is natural to require that 
all series coefficients are nonzero, i.e., 7„ 7^ for all v G No- 

Unfortunately, this is only a minimal requirement and not yet enough for our purposes. If 
in ( [2.13| ) is to be of order 0(z n+2fc+1 ) as z — > 0, then the ^-independent part 



z n+2k+l R (n) (z 



ofR^'(z) defined by 



has to satisfy 



Rt\ Z ) = cr + o(z 



(n) 



0, 



(2.16) 



C 



(n) 



± 0, k,neN . (2.17) 

If these conditions are satisfied, we can be sure that ( 2.13| ) is indeed the accuracy-through-order 
relationship we have been looking for. 

Personally, I am quite sceptical that it would be easy to characterize theoretically those power 
series which give rise to truncation errors Rjf' \z) satisfying ( 2.16| ) and ( 2.1 7| ) . Fortunately, it can 
easily be checked numerically whether a given (formal) power series leads to truncation errors 
whose z-independent parts are nonzero. If we set z = in (|1|) and use ([DJD, we obtain the 
following recursive scheme: 



a 



(n) 



c, 





in) 
k+l 



c 



■ 7n+l 
(n+2) 



n e N , 

(n+l)-|2 



a 



(n) 



k,n G N ■ 



(2.18a) 
(2.18b) 



Let us now assume that we know for a given (formal) power series that the z-independent 
parts Cu^ of the truncation errors R^\z) in O are nonzero - either from a mathematical 
proof or from a brute force calculation using fl2~18| ). Then, fl2~lp is indeed the accuracy-through- 
order relationship we have been looking for, which implies that A^f* can be expressed as follows: 



A 



(n) 



fn+2k(z) + Z 



n+2fc+l ^.(n) 



k, n G N 



If we use this ansatz in ( |2.11 ), we obtain the following recursive scheme: 



, n G N ■ 
(n+2). 



[7 n+ 2fc+2 + 5<&l 



(n+1) 



.2k + l+S^\z) 



k,n G N . 



(2.19) 

(2.20a) 
(2.20b) 



Here, 5® 



(n). 



ln+2k+2Z — 7 n+ 2/c+l t " ^fc 

and 5 2 ^\z) are defined by (^15|) . For k = 0, (|2.20b| ) yields 

1 2 



[in 



+2 



7n+l - 7n+2^ 



(2.21) 



10 



Ernst Joachim Weniger 



which is in agreement with (2.8). 

A comparison of ( |2.7D and ( 2,19| ) yields 



Gt ] + O(z) 



0. 



(2.22) 



Consequently, the z-independent part G^ of $>^ l> (z) is the prediction for the first coefficient 
7 n+ 2fc+i not used for the computation of A 



(«)/ 



(n) 



If we set z = in the recursive scheme (2.20) and use (2.22), we obtain the following recursive 



scheme for the predictions G k 



(»). 



G, 



0, 



o • 



n+l > 



G 



(n) 
fc+1 



G (n + 2) + 



n+2k+2 



G 



, 

(n+l)-|2 



7n+2fc+l 

i n) ofR^(z) and G< n) 
comparison of fl2l3l ), ( PD , (|2ls| ), and (|3|) yields: 



k, n G N 



(2.23a) 
(2.23b) 

(2.23c) 



The z-independent parts C y k ll) of R^ l> (z) and Gj c ' t; of $[^(2:), respectively, are connected. A 



G 



(n) 



^fc + 7n+2fc+l 



(2.24) 



In this article, rational approximants will always be used in such a way that the input data 
- the partial sums ( |1.4j ) of the (formal) power series (|1.3| ) - are computed in an outer loop, and 
for each new partial sum a new approximation to the limit is calculated. If the index m of the 
last partial sum f m (z) is even, m = 2^, we use in the case of Aitken's iterated A 2 process as 
approximation to the limit f(z) the transformation 



{/o(2),/i (*),..- ,/ 2 „(*)} - 
and if m is odd, m = 2fi + 1, we use the transformation 

{h(z),f 2 (z),... J 2ti+ i(z)} 



•'V 1 



A® 



(2.25) 



(2.26) 



With the help of the notation \x\ for the integral part of x, which is the largest integer v 
satisfying the inequality v < x, these two relationships can be combined into a single equation, 
yielding || Eq. (5.2-6)] 



{fm-2lm/2\{ z )i /m-2[m/2]+l (■ z ) ) • • • > fm(z)} ^ A 



(m-2[m/2]) 
[m/2] 



m G N 



(2.27) 



The same strategy will also be used if for example the rational expressions i?[ (z) defined by 
( 2.13| ) are listed in a Table. This means that the R^\z) will also be listed according to ( [2.27 ). 
The only difference is that the R^\z) use as input data not the partial sums f n (z) but the 
remainders [f n (z) — f(z)]/z n+1 . 
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3 Wynn's Epsilon Algorithm 

Wynn's epsilon algorithm |116(| is the following nonlinear recursive scheme: 



A n ) _ n J n ) 



n G Nq , (3.1a) 



+l/[ £ r ij -4l. k,neN . (3.1b) 



f (n) _ Jn+1) _,_ -| n Jn+l) _ Jn) 

» 



The elements e\J with even subscripts provide approximations to the (generalized) limit s of 

the sequence {s n }^L to be transformed, whereas the elements e^fc+i with odd subscripts are 
only auxiliary quantities which diverge if the whole process converges. 

If the input data are the partial sums (|l.4|) of the (formal) power series fll.3|) , s n = f n (z), 



then Wynn |116| could show that his epsilon algorithm produces Pade approximants: 

4? = [n + k/k] f (z). (3.2) 

The epsilon algorithm is a close relative of Aitken's iterated A 2 process, and they have similar 
properties in convergence acceleration and summation processes. A straightforward calculation 
shows that Ai = e% ■ Hence, Aitken's iterated A 2 process may also be viewed as an iteration 
of . However, for k > 1, A% and ei^ are in general different. 



There is an extensive literature on the epsilon algorithm. On p. 120 of Wimps book [113] it 
is mentioned that over 50 articles on the epsilon algorithm were published by Wynn alone, and 
at least 30 articles by Brezinski. As a fairly complete source of references Wimp recommends 
Brezinski's first book |jq| . However, this book was published in 1977, and since then many more 
articles on the epsilon algorithm have been published. Consequently, any attempt to produce 
something resembling a reasonably complete bibliography of Wynn's epsilon algorithm would 
clearly be beyond the scope of this article. 

In spite of its numerous advantageous features, Wynn's epsilon algorithm (|3.1|) is not suited 



for our purposes. If the input data are the partial sums (1.4) of the (formal) power series (1.3), 
the accuracy-through-order relationship ([O]) of Pade approximants in combination with ( |3.2| ) 
implies that the elements of the epsilon table with even subscripts can be expressed as 



4? = fn + 2 k {z) + $ z"+ 2fc+1 + 0(z"+ 2fc + 2 ) , * - . (3.3) 

(n) 

The constant g^J is the prediction made for the coefficient Jn^k+li which is the first coefficient 

of the power series ( |1.3| ) not used for the computation of . 

If we compute e% from the partial sums f n {z), f n +i{z), and f n+ 2(z), we obtain because of 

4 n) = the same expressions as in the last section. Thus, we obtain a result which does not 
seem to be in agreement with the accuracy-through-order relationship 

(n) , , v . 7n+i7n+2^ n+2 ,„ A , 

4 = /n+lO) + • (3-4) 

7n+l _ ln+2Z 
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Of course, the missing term j n ^2Z n+2 can easily be extracted from the rational expression on 
the right-hand side. We only have to use 1/(1 — y) = 1 + y/(l — y) with y = ^ n +2^/ln+i to 
obtain as in the case of Aitken's iterated A 2 algorithm an expression with the desired features: 



» 



fn+2{z) + 



n+3 



7n+l _ ln+2Z 



(3.5) 



This example shows that the accuracy-through-order relationship ( Q| ) of Pade approximants 
is by no means immediately obvious from the epsilon algorithm (jO). A further complication 

(n) 

is that the epsilon algorithm involves the elements e^fc+i w ith odd subscripts. These are only 
auxiliary quantities which diverge if the whole process converges. Nevertheless, they make it 
difficult to obtain order estimates and to reformulate the epsilon algorithm in such a way that 
it automatically produces suitable expressions for e$ of the type of (|3.5|). 

The starting point for the construction of an alternative recursive scheme, which would be 



suited for our purposes, is Wynn's cross rule [118 , Eq. (13)]: 



f £ (n 



) 

2k+2 



(n+1) 
-2k 



r 



+ 



>+2) ( 



2k-2 
-1 



n+in - 1 

z 2k j 



{4: , -4r 1) } +{ 



Xn+2) (rt+ 



2k 



-2k 



-1 



(3.6) 



This expression permits the recursive computation of the elements eiu with even subscripts 

(n) 

without having to compute the auxiliary quantities e^fe+i w ith °dd subscripts. The price, one 
has to pay, is that the cross rule ([3j]) has a more complicated structure than the extremely 
simple epsilon algorithm (3.1). 

A further complication is that for k = the undefined element occurs in (3.6). However, 



we obtain results that are consistent with Wynn's epsilon algorithm (3.1) if we set e_\ 



oo. 



Hence, instead of the epsilon algorithm Q3.1|), we can also use the following recursive scheme: 



= o° ; = s n , n G No , (3.7a) 

4? + 2 = 4T 1) + — ^ . k,neN . (3.7b) 

+ 



LAt 2k ^ e 2fc e 2fc fc 2fc-2 



For our purposes, this recursive scheme is an improvement over the epsilon algorithm (3.1 



(n) 

since it does not contain the elements e^fe+i with odd subscripts. Nevertheless, it is not yet 



what we need. The use of ( [3.7D for the computation of would produce ( |3.4[ ) but not (3.5). 



Fortunately, (3.7) can easily be modified to yield a recursive scheme having the desired features: 
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» 



» 

z 2k+2 



OO , 



>+2) 
-2k 



» 



n € N, 



o 



Ae 



(n+l) 
2k 



Ae 



(n+l) 
2k 



Ae 



+ 



(n) 

2A: 



(n+l) (n+2) 



-2k 



~2k-2 



k,n G N, 



1 



1 



Ae 



(n+l) 



Ae. 



+ 



1 







(3.8a) 
(3.8b) 



.(n+l) (n+2) 



-2fc ^ c 2fc c 2fc c 2fc-2 

If we use ( [3.8D for the computation of ej,' 1 ' 1 , we obtain ( |3.5[ ) . 

Next, we use in (3^8) the partial sums (1.4) of the (formal) power series ( |L3|) in the form of 
(EP3 ). This yields: 



fc 2fc 



i+2fc+l „(n) 
'2k 



(z) 



(3.9) 



The quantities r^(z) can be computed with the help of the following recursive scheme which 
is a direct consequence of the recursive scheme ( |3.8[ ) for e$ : 

/»(*) " /(*) 



J] 7n+f+l 2 l 

!/=0 



7 n+l 



<5rT^ J (z) 



.(n+2), 



2 + 



>+l), 



<^ n+1) (z) «5r< n) (z) 



5r 



(n+l) 
2k 



(z) 



n € N , 



n G N , 



*rSr i} (*) 



(3.10a) 



(3.10b) 



r. 



(n) 
2fc+2 



(*) 



Jn+2) 
2k 



(*) + 



5r™{z) zrg \z)-r^ k _{{z) 
1 z z 



k,n£ N . (3.10c) 



Sr. 



2k 



Here, Sr^(z) is defined by ( 2. 15| ) . It should be noted that ( 3.10b ) follows from ( p. 10c ) if we 
define r_2(z) = oo. 

Similar to the analogous accuracy-through-order relationship (2.13) for Aitken's iterated A 2 
process, (3J)) has the right structure to serve as an accuracy-through-order relationship for 
Wynn's epsilon algorithm. Thus, it seems that we have accomplished our aim. However, we are 
faced with the same complications as in the case of (pT3D . If z n+2k+1 r { ^ ] (z) in Q is to be of 
order 0( 



n+2fc+l 



) as z — > 0, then the z-independent part c^} of r^f \z) defined by 



» 

2k 



0(z), 



0, 



(3.11) 
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has to satisfy 



+ 0, k,neN . 



(3.12) 



If this condition is satisfied, we can be sure that (3.9) is indeed the accuracy-through-order 
relationship we have been looking for. 

As in the case of Aitken's iterated A 2 process, it is by no means obvious whether and how 
it can be proven that a given power series gives rise to truncation errors t^{z) satisfying ( |3.11 ) 
and ( |3.12| ). Fortunately, it can easily be checked numerically whether a given (formal) power 
series leads to truncations errors whose z-independent parts are nonzero. If we set z = in 
( 3.1 0| ) and use ( f3.ll ), we obtain the following recursive scheme: 



» 



in) 



» 
-2k+2 



■ 7„ + i , n G N , 



„(n+2) 



>+2) 
-2k 



,(n+l)-|2 
'0 J 



>) 
c 

>+l)-|2 
-2k 



» 
"2k 



+ 



n G N 



4r"] 2 

An+2) 
c 2k-2 



£; G N , n G N, 



o ■ 



(3.13a) 
(3.13b) 

(3.13c) 



If we define = °°> then (3.13b) follows from ( |3,13cp . 

Let us now assume that we know for a given (formal) power series that the ^-independent 
parts Cgfc of the truncation errors (z ) in (|3.9| ) are nonzero - either from a mathematical proof 
or from a brute force calculation using (|3.13|) . Then, (fj) is indeed the accuracy-through-order 



(n) 

relationship we have been looking for. This implies that eL can be expressed as follows: 



. 2 , - / n+2fe (^) + ^ +2fc+1 ^ ) W- 
If we use this ansatz in ( p.8| ), we obtain the following recursive scheme: 

0, 



{n) ( 



{n)( 
<P 2 \ z 



(n) i 



» 



P. 



(n) f 
2k+2 \ 



n G N , 
[ln+2] 2 



7n+l - ln+2Z 



n G N , 



(n+2), \ 
</>2& ( Z ) + 



a 2k+2^ Z ) 



(n) , 
2k+2^ 



1 X (n+1) f x 
7 w+2 fc+2 + <fy>2fc \ z ) 

7n+2fc+l + ^2fc ) ( 2! ) 



1 £ (n+1), \ 
7n+2fc+2 + <V 2fc (2) 

+ 



k G N , n G N 



, X (n+1), N 
7»+2fc+2 + 0(p 2k (g) 

. 0+1)/ \ (n+2)/ \ 
7n+2fc+l + Mfc (^) - V 2 fc-2 \ z ) 



(3.14) 

(3.15a) 
(3.15b) 

(3.15c) 
(3.15d) 



7n+2fc+l + 8tp%> (z) 



(n+1) / \ !. U — L ! , 

7n+2fc+l + Mfc ( Z ) ~ ^2k-2 \ z ) 



(n+2) 



(3.15e) 
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Here, S(p^l (z) is defined by (|2.15| ). Moreover, we could also define <p_ 2 (z) = oo. Then, ( |3.15b|) 
would follow from ( |3.15c ). 



A comparison of ( p.3|) and (|3.14|) yields 



z^O. 



(3.16) 



Consequently, the z-independent part g 2k of tp 2k (z) is the prediction for the first coefficient 

(n) 

j n+ 2k+i not used for the computation of e 2k . 



If we set z = in the recursive scheme (3.15) and use (3.16), we obtain the following recursive 

(»). 



scheme for the predictions g\u ■ 

0. 

[ln+2 



(n) 
% 



(n) 
92 



(n) 
92k+2 



, n G N , 

2 

n G N 



7n+l 
(n+2) 

fc G N, 



(n+l)i2 



r i n 

[7n+2fc+2 - g 2 fc 

(n) 

7n+2fc+l - 9 2 k 

n G N • 



r (n+l)i2 
[7n+2fc+2 - ff 2 fc I 
(n+2) 

7n+2fc+l - S 2 fc-2 



(3.17a) 
(3.17b) 

(3.17c) 



If we define g^ 2 = oo, then ( 3.17b ) follows from ( |3,17a| ) and ( |3.17c ). 



The z-independent parts of r 2k (z) and g 2k of ip 2k {z), respectively, are connected. A 



» 



(n) 



comparison of Q, (gT4j) , and ( B) yields: 



(n) 



» 
-2fc 



+ 7n+2fc+l 



(3.18) 



Concerning the choice of the approximation to the limit, we proceed in the case of the epsilon 
algorithm just like in the case of Aitken's iterated A 2 process and compute a new approximation 
to the limit after the computation of each new partial sum. Thus, if the index m of the last 
partial sum f m (z) is even, m = 2fj>, we use as approximation to the limit f(z) the transformation 



{/«,(*), /!(*),... J2»(z)}^e^, 
and if m is odd, m = 2fi + 1, we use the transformation 

{fi(z)J 2 (z),... J^iWjHeW 
These two relationships can be combined into a single equation, yielding 



(3.19) 



(3.20) 



Eq. (4.3-6)] 



(m-2[m/2j) 



{fm-2§m/2}{ Z )i /m-2[?n/2j+l • • • j /m(#)} ^ € 2[[m/2] 



m G N . 



(3.21) 
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= o, 


(n) 
2k+l 


,q(«+i) 


(n) 
2/c+2 


„q(™+ 1 ) 



4 The Iteration of Brezinski's Theta Algorithm 

Brezinski's theta algorithm is the following recursive scheme 

4 B) = s «> nGN , (4.1a) 
= C^ + l/fA^], /c, n G No , (4.1b) 

+ L 2fc J r L n ) + > fc,nGN . (4.1c) 

As in the case of Wynn's epsilon algorithm (|3.1|), only the elements tfjfc with even subscripts 
provide approximations to the (generalized) limit of the sequence to be transformed. The ele- 

(n) 

ments l?2fc . l W1 ^h odd subscripts are only auxiliary quantities which diverge if the whole process 
converges. 

The theta algorithm was derived from Wynn's epsilon algorithm ( |3.1| ) with the intention 
of overcoming the inability of the epsilon algorithm to accelerate logarithmic convergence. In 
that respect, the theta algorithm was a great success. Extensive numerical studies of Smith and 
Ford [87, 88] showed that the theta algorithm is not only very powerful, but also much more 



versatile than the epsilon algorithm. Like the epsilon algorithm, it is an efficient accelerator for 
linear convergence and it is also able to sum many divergent series. However, it is also able to 
accelerate the convergence of many logarithmically convergent sequences and series. 



As for example discussed in [97|, new sequence transformations can be constructed by it- 
erating explicit expressions for sequence transformations with low transformation orders. The 
best known example of such an iterated sequence transformation is probably Aitken's iterated 
A 2 process ( |2,4j ) which is obtained by iterating Aitken's A 2 formula ( |2.2| ). 

The same approach is also possible in the case of the theta algorithm. A suitable closed-form 



expression, which may be iterated, is |)5[ Eq. (10.3-1)] 

- s ^ [As ra ] [As n+1 ] [A 2 Sn+1 ] 

2 " n+1 [As n+2 ] [A 2 .„] - [As n ] [A 2 Sn+1 ] ' (4 - 2) 



The iteration of this expression yields the following nonlinear recursive scheme [95, Eq. (10.3-6)]: 



Jo (n) = s n, neNo, (4.3a) 



[A jW] [Ajt +1) ] [A 2 jW] 

r(") 



J<$ = L " fe JL 7 1^-^ Vm". Me N . (4.3b) 

[AJ -(n +2)] [Aajjr)] _ [AJ ( n)] [A2J (^ , 



In convergence acceleration and summation processes, the iterated transformation J'l has 
similar properties as the theta algorithm from which it was derived: They are both very powerful 

(n) 

as well as very versatile. is not only an effective accelerator for linear convergence as 
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well as able to sum divergent series, but it is also able to accelerate the convergence of many 
logarithmically convergent sequences and series [11, 74-77, 95, 97, 100 ] . 

In spite of all these similarities, the iterated transformation J^f 1 has one undeniable advan- 

(n) 

tage over the theta algorithm, which ultimately explains why in this article only is studied, 
but not the theta algorithm: The recursive scheme ([4.31) for jj^ is slightly less complicated 



than the recursive scheme (4.1) for the theta algorithm. On p. 282 of |95| it was emphasized 
that a replacement of ( 4.1b| ) by the simpler recursion 



(n) 
2k+l 



Mi 

2k J 



tn£N, 



o ■ 



(4.4) 



would lead to a modified theta algorithm which satisfies "d^k = 31 - 

It is a direct consequence of the recursive scheme ( f4.3| ) that 3k + 1 sequence elements s n , 
s n+ i, . . . , s„ + 3fc are needed for the computation of j[ yK Thus, we now choose as input data 
the partial sums ( |1.4| ) of the (formal) power series ( |l~3| ) according to s n = f n (z), and conjecture 

(n) 

that all coefficients 70, 71, ... , J n +3k, which were used for the construction of , are exactly 
reproduced by a Taylor expansion. This means that we have to look for an accuracy-through- 
order relationship of the following kind: 



r(n) 



f(z) - 3y 



(n) 



0(z n+3k+1 ) , 



0. 



(4.5) 



(n) 

Such an accuracy-through-order relationship would imply that Jt can be expressed as follows: 



(n) 



fn+3k{z) + Gf, 



(™) 'n+3k+l 



+ 0(z 



n+3fc+2 



0. 



(4.6) 



(n) 

The constant Q k is the prediction made for the coefficient 7 n+ 3fc + i, which is the first coefficient 

of the power series (|1.3| ) not used for the computation of J^ 1 ■ 

Unfortunately, the recursive scheme (4.3) is not suited for our purposes. This can be shown 
by computing j[ n ' from the partial sums f n {z), fn+i(z), f n+2 (z), and /„ +3 (z): 



31 



(n) 



fn+l(z) 



ln+lln+2[ln+3Z - r y n +2\z n+2 

ln+3z[jn+2Z ~ Jn+l] ~ 7n+l[7n+3^ ~ ln+2] 



(4.7) 



Superficially, it looks as if the accuracy-through-order relationship (|4.5| ) is not satisfied by J^ 1 . 
However, the rational expression on the right-hand side contains the missing terms r y n +2Z n+2 
and 7 n+ 3Z n+3 , as shown by the Taylor expansion 

7 n+ l7 n+2 [7n+3^ - ln+2]z n+2 



~jn+3z["1n+2Z ~ In 



+1 



Jn+2Z n+2 + 7 



ln+l[ln+3Z ~ Jn+2] 

7n+3{ lln+2} 2 ~ 27 n+ i7 n+3 |z nH 



-3Z 



ln+lln+2 



+ 0{z n+5 ) . (4.8) 
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Thus, an expression, which is in agreement with (H 

(n) 

the simplest transform . Moreover, the Taylor expansion 
prediction 



can be obtained easily in the case of 



shows that J-y makes the 



(n) 



7n+3{ [ln+2\ 2 ~ 27 n+ i7 n+3 | 
ln+lln+2 



(4.9) 



(n) 

for the first series coefficient 7 n +4 not used for the computation of J\ . Of course, by including 



additional terms in the Taylor expansion ( |4.8| ) further predictions on series coefficients with 
higher indices can be made. 

(n) 

However, in the case of more complicated transforms Jt with k > 1 it by no means 
obvious whether and how an expression, which is in agreement with (fl.6|), can be constructed. 
Consequently, it is certainly a good idea to replace the recursive scheme (fD|) by an alternative 

(n) 

recursive scheme, which directly leads to appropriate expressions for Jf' with k > 1. 

Many different expressions for in terms of s n , s n+ i, s n+ 2, and s n +3 are known 95, Section 
10.4]. The for our purposes appropriate expression is 



(n) 



Sn+3 



[As n+2 ] { [As n+2 ] [A 2 s n ] + [As n+1 ] 2 - [As n+2 ] [As n ]} 



[As n+2 ] [A 2 s n ] - [As n ] [A 2 
Just like (|4.2[), this expression can be iterated and yields 



7-0) 


— s n , n 


GN , 


rr(n) 
J k+l 


^(n+3) 


A (n) 


An) 


= [AJ fc (n+2) 


{ [Ajt + 2) ] [A 2 jM] + [Ajt +1) ] 2 



D 



(n) 
fe+1 



[AJ (n + 2 }] [A ^ n)] _ [Ajjr)] [A 2j, 



r(n) 



(n)l 



r(n+l)i 



(4.10) 

(4.11a) 
(4.11b) 

(4.11c) 
(4.11d) 



If we now use either ( |4.10|) or (|4.1lD to compute j[ from the partial sums f n (z), f n+ i(z), 
fn+2(z), and f n+ z(z), we obtain the following expression which obviously possesses the desired 
features: 



(n) 



fn+3(z) 



7n+3{7n+3 [ln+2Z ~ 7n+l] + [ln+2] 2 ~ ln+lln+z\z 



n+4 



In+^Z [jn+2Z ~ 7n+lJ ~ ln+1 [ln+3Z ~ ln+2 



[in 



(4.12) 



Next, we use in ( 4.1 1| ) the partial sums ( |1.4j ) of the (formal) power series ( |1.3|) in the form 
of (|2~12|). This yields: 



(n) 



/(*) + z n+3fc+1 ^ n) (z), fc, re G 



(4.13) 
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The quantities TZ^\z) can be computed with the help of the following recursive scheme which 
is a direct consequence of the recursive scheme (4.11) for J^ 1 '- 



in), 



fn(z) - f(z) 



yU + 1 



n G N, 



o ■ 



u=0 



(n+3). 



in) , 
k+1^ 



fe, n G N 



[5n^ +2) (z)]{[5izt +2 \z)] [5 2 nP(z)] + K" +1) (,)] : 



(z) 



:[5TZ 



(n+2) 



[^(z)] - [^(,)]^< +1J (^)] 



(«)/ 



,(»+!), 



(4.14a) 
(4.14b) 

(4.14c) 
(4.14d) 



Here, ^ n+2) (z) and 5 2 ^ n+2) (z) are defined by ( gig ). 

Similar to the analogous accuracy-through-order relationships ( |2.13| ) and (3.9) for Aitken's 
iterated A 2 process and the epsilon algorithm, respectively, (|4.13 ) has the right structure to 
serve as an accuracy-through-order relationship for the iterated theta algorithm. Thus, it seems 

that we have accomplished our aim. However, we are faced with the same complications as in 

( n )/ ^ (U i qi\ \c +^ u„ „f „„A„„ r\l „n+3fc+l) 



the case of (2.13[) and 



. If z n+3k+1 TZ ( 2k '[z i in 



then the z-independent part C^ 1 ' of 7Z^ l> (z) defined by 



>(")/ 



( P^D is to be of order 0(z n+3k+1 ) as z -> 0, 



C^ + Oiz), z^O, 



has to satisfy 



& } + 0. 



k, n G N . 



(4.15) 



(4.16) 



If this condition is satisfied, then it is guaranteed that ( |4.13| ) is indeed the accuracy-through- 
order relationship we have been looking for. 

As in the case of Aitken's iterated A 2 process or the epsilon algorithm, it is by no means 
obvious whether and how it can be proven that a given power series gives rise to truncation 
errors IZ^(z) satisfying ( f4.15| ) and (4.16). Fortunately, it can easily be checked numerically 
whether a given (formal) power series leads to truncations errors whose z-independent parts are 
nonzero. If we set z = in ( [4.14| ) and use (4.15), we obtain the following recursive scheme: 



(n) 



C, 



,(n) 



c 



ln+l , 
(n+3) 



n G N 



C 



(n+2) 



• 

or (n) r (n+2) 



[4" +1) ] 2 } 



r (n) r (n+l) 



k,n G No • 



(4.17a) 
(4.17b) 



Let us now assume that we know for a given (formal) power series that the ^-independent 
parts of the truncation errors TZ^\z) in ( 4.13j ) are nonzero - either from a mathematical 
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proof or from a brute force calculation using (4.17). Then, (|4.13|) is indeed the accuracy-through 



(n) 

order relationship we have been looking for. This implies that jt can be expressed as follows: 



Jt ] = fn + 3k(z) + z n+3k+1 ^\z) , k,n € No . (4.18) 
If we use this ansatz in ( f4.11| ), we obtain the following recursive scheme: 

^\z) = 0, ne N , (4.19a) 

, s 7n+3 { 7n+3 [jn+2Z ~ 7n+l] + [ln+2\ 2 ~ 7n+l7n+3 \ 

< } W = l —r i f 1 — - > nGN , (4.19b) 

7n+3 [7n+2Z ~ 1n+l\ ~ 7n+l |_7n+3^ ~ ln+2\ 
]\f(. n ) ( ) 

D k+i( z ) 

Nit(z) = [ 7n . + 3 fc+ 3 + ^l n+2) (^)] 

X { [7n+3fc+3 + ^t +2 \z)] [ ln+Zk+2 Z - 7n+3fc+1 + ^f\z)] 
+ [ln +3k+ 2+5^ +1) (z)] 2 

~ bn + 3k + l + 8*?\z)] [7n + 3fc + 3 + M[ n+2 \z)] } , (4.19d) 
Dtl{z) = [7n + 3 fc+ 3 + ^l" +2) (z)][7n + 3 fe+ 2^-7n + 3 W + 5 2 ^" ) (^ 

" [7n+3fc+l + (*)] bn+3k+3Z - 7 „+3fc+2 + S 2 ^ +1) (z)] . (4.19e) 



Here, 5^> k n+2 \z) and 5 2 ^ k n+2 \z) are defined by (JDJ) 
A comparison of ( |4.6[) and (|4.18|) yields 



*£\z) = G ( k n) + 0(z), z^O. (4.20) 



Consequently, the ^-independent part of ^ k n \z 



is the prediction for the first coefficient 

(n) 

7 n+ 3fc_i_i not used for the computation of J k . 

If we set z = in the recursive scheme (4.19) and use (4.20), we obtain the following recursive 
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scheme for the predictions Q 



in). 



An) 
^0 


= 0, n 


eN , 


gin) 


7n+3{ 


7 n+2 ] 2 - 27 n+ i7 n+3 } 

J , n G No 

7n+l7n+2 


An) 
^k+l 


An+3) 
— y k 


pin) 


pin) 
r k+l 


= [7n+3fc+3 


- ^ +2) ] { [7n+3fe+2 - 2 



' 2 [7n+3fc+l - G^] 



r r>( n + 2 )l 
|_7n+3fc+3 - £/* | 



if 



(n) 
fe+1 



[7n+3fc+l - ^fc n) ] 



r A n +1)~\ 
|_7n+3fc+2 - y k \ 



(4.21a) 
(4.21b) 

(4.21c) 

(4.21d) 
(4.21e) 



The z-independent parts cj^ of 1Z k n \z) and of Vl/j^(z), respectively, are connected. A 



comparison of flEISp , ( gig ), ( gT| ), and QOCP yields: 



g (n) 



+ 7n+3/c+l • 



(4.22) 



As in the case of Aitken's iterated A 2 process or Wynn's epsilon algorithm, a new approxi- 
mation to the limit will be computed after the computation of each new partial sum. Thus, if 
the index m of the last partial sum f m (z) is a multiple of 3, m = 3/i, we use as approximation 
to the limit f(z) the transformation 



{/CO*), /!(*),... ,/3^)}^j(°), 
if we have m = 3/i + 1, we use the transformation 

{fi(z)J 2 (z),... ,h^i{z)}^jjp 
and if we have m = 3fi + 2, we use the transformation 

{f 2 (z),Mz),... J w (z)}^jM 



(4.23) 



(4.24) 



(4.25) 



These three relationships can be combined into a single equation, yielding (p5l Eq. (10.4-7)] 



{fm-3lm/3}( z ): /m-3[m/3]+l ( z ) : • • • > fm(z)} ^ «7j[ m /3] 

5 Applications 



(m-3[m/3]) 



m G N • 



(4.26) 



In this article, two principally different kinds of results were derived. The first group of results - 
the accuracy-through-order relationships (|2.13j ), fl3.9|) , and ( 4.13 ) and the corresponding recur- 



sive schemes ( p. 14 ), Q3.9| ), and (4.14) - defines the transformation error terms 



y n+2fc+l nW 
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z n+2k+l r W^ z ^ anc } z n+ ^ k+1 1Z^\z) . These quantities describe how the rational approximants 

tnu , and J^ 1 differ from the function f(z) which is to be approximated. Obviously, the 
transformation error terms must vanish if the transformation process converges. 

The second group of results - ( |2.19| ), ( |3.14| ), and fl4.18| ) and the corresponding recursive 
schemes ( ^20|) , (|3.15|) , and (|4.19|) - defines the terms z n+2k+1 ^ ] (z), z n+2k+1 tp$ (z) , and 
z n+3k+l-q,W These quantities describe how the rational approximants «4jj. , e^t , and 
differ from the partial sums f n +2k( z ) an d f n +3k( z ), respectively, from which they were con- 
structed. Hence, the first group of results essentially describes what is still missing in the 
transformation process, whereas the second group describes what was gained by constructing 
rational expressions from the partial sums. 

The recursive schemes (|2~14|) , Q, and of the first group use as input data the 

remainder terms 



fn(z) ~ f(z) 



ln+u+l Z V . (5.1) 



u=0 

In most practically relevant convergence acceleration and summation problems, only a finite 
number of series coefficients 7^ are known. Consequently, the remainder terms (5.1) are usually 
not known explicitly, which means that the immediate practical usefulness of the first group of 
results is quite limited. Nevertheless, these results are of interest because they can be used to 
study the convergence of the sequence transformations of this article for model problems. 
As an example, let us consider the following series expansion for the logarithm, 

00 



m + 1 



2 .Fi(l,l;2;-z) = X, ZTTT ' ( 5 - 2 ) 



m=0 

which converges for all z G C with \z\ < 1. The logarithm possesses the integral representation 

M±±A = r^, (5 . 3) 

z Jo 1 + zt' y ' 

which shows that ln(l + z)/z is a Stieltjes function and that the hyper geometric series on the 
right-hand side of (5.2) is the corresponding Stieltjes series (a detailed treatment of Stieltjes 
functions and Stieltjes series can for example be found in Section 5 of II). Consequently, 
ln(l + z)/z possesses the following representation as a partial sum plus an explicit remainder 
which is given by a Stieltjes integral (compare for example Eq. (13.1-5) of p5|): 

ln(l + z) _ ^ {-z) m , , +1 f 1 t n+1 dt 



, ~ tA m + 1 + '~ Jo TTzi' n6N »' (5 ' 4) 

For \z\ < 1, the numerator of the remainder integral on the right-hand side can be expanded. 
Interchanging summation and integration then yields: 

fl j.n+ljj. 00 / 1 \n+m+l „m 

( _ ir+ i J = y Lii * . ( 5.5) 

Jo 1 + zt ^ n + m + 2 K ' 
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Next, we use for < n < 6 the negative of these remainder integrals as input data in the recursive 
schemes Q2.14Q , (|3~9l) , and and do a Taylor expansion of the resulting expressions. Thus, 

we obtain according to fl2.13| ), ( |3.9|) , and ( 4.13 ): 



"^3 


ln(l + z) 


+ 




z 




4°' 


ln(l + z) 


+ 




z 






ln(l + z) 

z 


+ 



421z 



7 



79632 lz b 



16537500 8682187500 

z 7 3lz 8 113z 9 
+ 



+ 



9800 

„7 



77175 
19z' 



810757427z 9 
4051687500000 

+ 0(z 10 ) , 



37800 198450 4725 



120050 

+ + 0(z 10 



+ 0(z 10 ) , (5.6a) 
(5.6b) 
(5.6c) 



All calculations were done symbolically, using the exact rational arithmetics of Maple. Conse- 
quently, the results in fl5.6j ) are exact and free of rounding errors. 

The leading coefficients of the Taylor expansions of the transformation error terms for 
and J 2 (0) are evidently smaller than the corresponding coefficients for el . This observation 
provides considerable evidence that Aitken's iterated A 2 process and Brezinski's iterated theta 
algorithm are in the case of the series fl5.2|) for ln(l + z)/z more effective than Wynn's epsilon 
algorithm which according to ( |3.2| ) produces Pade approximants. 

This conclusion is also confirmed by the following numerical example in Table I, in which the 
convergence of the series ( |5.2| ) for ln(l + z)/z is accelerated for z = 0.95. The numerical values 
of the remainder terms ( |5.5| ) were used as input data in the recursive schemes ( p. 14 ) , (|3.9| ) , and 
( 4.14| ) to compute numerically the transformation error terms in ( |2~l3D , Q, and gd§. The 
transformation error terms, which are listed in columns 3-5, were chosen in agreement with 
(|2T2l ), ( ^2l|) , and (|4.26|) , respectively. 



The zeros, which are found in columns 3 - 5 of Table I, occur because Aitken's iterated A 2 
process and Wynn's epsilon algorithm can only compute a rational approximant if at least three 
consecutive partial sums are available, and because the iteration of Brezinski's theta algorithm 
requires at least four partial sums. 

The result in Table I show once more that Aitken's iterated A 2 process and Brezinski's 
iterated theta algorithm are in the case of the series ( |5.2j ) for ln(l + z)/z apparently more 
effective than Wynn's epsilon algorithm. 

The second group of results of this article - ( p.!9| ), ( 3.14 ), and ( 4.18; ) and the corresponding 
recursive schemes (|]2|), (|jj|), and (|1|) - can for example be used to demonstrate how 
rational approximants work if a divergent power series is to be summed. 



Let us therefore assume that the partial sums, which occur in ( 2.19 ), ( 3.14 ), and ( 4.18 ), 
diverge if the index becomes large. Then, a summation to a finite generalized limit f(z) can 
only be accomplished if z n+2k+l ^\z) and z n+2k+1 ip^ (z) in ( |2.19|) and (|3.14| ), respectively, 
converge to the negative of f n +2k( z )i an d if ^ n+3fc+lv I / [ n ' ) (^) in fl4.18| ) converges to the negative 
of fn+3k{z). 

Table II shows that this is indeed the case. We again consider the infinite series ( |5.2p for 
ln(l + z)/z, but this time we choose z = 5.0, which is clearly outside the circle of convergence. 
We use the numerical values of the partial sums Y2m=o(~ z ) m /( m + 1) with < n < 10 as input 
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Table I: Convergence of the Transformation Error Terms 

Transformation of ln(l + z)/z = ^m=o( — z ) m /( m + 1) f° r z = 0.95 



00 ^_^n + m z m 

n Z^m=0 n+m+2 



y n+l R (n-2jn/2j)^ 



>/2] 
Eq. (E 



3D 



.1 (n-2ln/2l)/ x 
r 2ln/2] 1 " < 

Eq 



y n+l-r>( n - 3 I n /3])/ n 

Eq. gl3D 






0.312654 


10° 























1 


-0.197206 


10° 























2 


0.143292 


10° 


0.620539 


10" 


-2 


0.620539 


io- 


-2 









3 


-0.112324 


10° 


-0.230919 


io- 


-2 


-0.230919 


10" 


-2 


0.113587 


10" 


-2 


4 


0.922904 


io- 1 


0.109322 


10" 


-3 


0.156975 


10" 


-3 


-0.367230 


io- 


-3 


5 


-0.782908 


io- 1 


-0.333267 


10" 


-4 


-0.466090 


io- 


-4 


0.148577 


io- 


-3 


6 


0.679646 


io- 1 


0.131240 


io- 


-5 


0.413753 


10" 


-5 


0.137543 


io- 


-5 


7 


-0.600373 


io- 1 


-0.371684 


10" 


-6 


-0.108095 


io- 


-5 


-0.392983 


io- 


-6 


8 


0.537619 


io- 1 


0.111500 


10" 


-7 


0.110743 


10" 


-6 


0.131377 


10" 


-6 


9 


-0.486717 


io- 1 


-0.311899 


io- 


-8 


-0.266535 


io- 


-7 


0.412451 


io- 


-9 


10 


0.444604 


io- 1 


0.689220 


10" 


-10 


0.298638 


io- 


-8 


-0.139178 


io- 


-9 


11 


-0.409189 


io- 1 


-0.199134 


10" 


-10 


-0.678908 


10" 


-9 


0.475476 


10" 


-10 


12 


0.378992 


io- 1 


0.282138 


10" 


-12 


0.808737 


10" 


-10 


-0.316716 


10" 


-12 



data in the recursive schemes ( |2.2C ), (3.15), and ( |4.19| ) to compute the transformation terms in 
( 2.191 ), ( p. 14 ), and ( 4.18; ). The transformation terms, which are listed in columns 3 - 5 of Table 
II, were chosen in agreement with ( [2.27j ), ( |3.21 ), and ( |4.26 ), respectively. All calculations were 
done using the floating point arithmetics of Maple. 

The results in Table II show that a sequence transformation accomplishes a summation of 
a divergent series by constructing approximations to the actual remainders. Both the partial 
sums as well as the actual remainders diverge individually if their indices become large, but 
the linear combination of the partial sum and the remainder has a constant and finite value for 
every index. 

The fact, that the transformation terms in (|2.19 



3.14) ), and ( 4.18 ) approach the negative of 
the corresponding partial sums of course also implies that one should not try to sum a divergent 
series in this way. The subtraction of two nearly equal terms would inevitably lead to a serious 
loss of significant digits. 

In the next example, the transformation terms in ( |2.19| ), ( |3.14j ), and ( [4.18 ) will be used to 
make predictions for unknown series coefficients. For that purpose, it is recommendable to use 
a computer algebra system like Maple, and do all calculations symbolically. If the coefficients of 
the series to be transformed are exact rational numbers, the resulting rational expressions are 
then computed exactly. 

We use the symbolic expressions for the partial sums Ylrn=o(~ z ) m /( m + 1) with < n < 12 
of the infinite series (|5.2| ) for ln(l + z)/z as input data in the recursive schemes (|2~20| ), (jl| ), and 
( 4.19| ). The resulting rational expressions z 13 Q^\z), z 13 (/?^( 2 )) an d z 13 ^^ with unspecified 
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Table II: Convergence 

Transformation of ln(l + 



of Transformation Terms to the Partial Sums 

z)/z = E„ =0 (-2) m /(m + 1) for z = 5.0 



{-z) m 
m=0 m+1 



Eq. pl9|) 



n+1 MW2]), , 

Z ^2[n/2] y Z i 



Eq. (|3l4|) 



n+l, T( (™-3|In/3l) 
W [n/3J 1 

Eq. IKW) 



*) 






0.1000000000 


10 1 

















1 


-0.1500000000 


10 1 

















2 


0.6833333333 


10 1 


-0.6410256410 


10 1 


-0.6410256410 


10 1 







3 


-0.2441666667 


10 2 


0.2467105263 


10 2 


0.2467105263 


10 2 


0.2480158730 


10 2 


4 


0.1005833333 


10 3 


-0.1002174398 


10 3 


-0.1002155172 


10 3 


-0.1002604167 


10 3 


5 


-0.4202500000 


10 3 


0.4205996885 


10 3 


0.4205974843 


10 3 


0.4206730769 


10 3 


6 


0.1811892857 


10 4 


-0.1811533788 


10 4 


-0.1811532973 


10 4 


-0.1811533744 


10 4 


7 


-0.7953732143 


10 4 


0.7954089807 


10 4 


0.7954089068 


10 4 


0.7954089765 


10 4 


8 


0.3544904563 


10 5 


-0.3544868723 


10 5 


-0.3544868703 


10 5 


-0.3544868636 


10 5 


9 


-0.1598634544 


10 6 


0.1598638127 


10 6 


0.1598638125 


10 6 


0.1598638127 


10 6 


10 


0.7279206365 


10 6 


-0.7279202782 


10 6 


-0.7279202781 


10 6 


-0.7279202782 


10 6 



z are then expanded, yielding predictions for the next series coefficients that are exact rational 
numbers. Only in the final step, the predictions for the next series coefficients are converted to 
floating point numbers in order to improve readability: 



12 |_ y 

= V ^—t 0.07142857137 z 13 + 0.06666666629 z 14 

O Z-^ m _J_ 1 



: 12 



n m + 1 

rn=0 



0.06249999856 z 15 + 0.05882352524 z 16 + 0(z 17 ) , (5.7a) 



12 , , 



V 0.07142854717 z 13 + 0.06666649774 z 

^ m + 1 

rn=0 



14 



0.06249934843 z 15 + 0.05882168762 z 16 + 0(z 17 ) , (5.7b) 



12 / \TTi 

jP = V 0.07142857148 z 13 + 0.06666666684 z 14 

4 L^i m _|_ 1 



m+1 

m=0 



0.06249999986 z 15 + 0.05882352708 z 16 + 0(z 17 ) , (5.7c) 



12 



lnfl + z) (— zY 

1 - V- - 0.07142857143 z 13 + 0.06666666667 r 14 

^ m + 1 



m=0 



0.06250000000 z 15 + 0.05882352941 z 16 + 0(z 17 ) . (5.7d) 



The accuracy of the prediction results in ( |5.7| ) is quite remarkable. The coefficients 7 m = 
(— l) m /(m + 1) with < m < 12 are the only information that was used for the construction of 

the transformation terms z 13 Q^ (z), z^ipf^iz), and z 13 ^^f \ which were expanded to yield the 
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results in (|5.7|), The accuracy of the approximations to the next four coefficients should suffice 
for many practical applications. 

As in all other application, Wynn's epsilon algorithm is in (5.7) slightly but significantly less 
effective than Aitken's iterated A 2 process and Brezinski's iterated theta algorithm. 



Instead of computing the transformation terms z 13 $g U,) (z), z 13 (^^(z), and z 13 ^ / ^ u; , it is of 
course also possible to compute «4.g , , and J4 directly via their defining recursive schemes, 



13yt,(°) 



and to expand the resulting rational expressions with a symbolic system like Maple. This would 
lead to the same results. However, in order to extract the partial sum J2m=o(~ z) m /(m + 1) 



from the rational approximants A^* , e^, and ^ , one would have to compute their 12-th 
order derivatives, and only the next derivatives would produce predictions to unknown series 
coefficients. Thus, this approach can easily become very expensive. In contrast, the use of the 
transformation terms requires only low order derivatives of rational expressions. 

If only the prediction of a single unknown term is to be done, then it is of course much more 
efficient to use the recursive schemes ( 2.23 ), ( 3.17 ), and ( [4.21 ). The input data of these recursive 
schemes are the coefficients of the series to be transformed, and no differentiations have to be 
done. 



6 Summary and Conclusions 

As already mentioned in Section [l], it has become customary in certain branches of theoretical 
physics to use Pade approximants to make predictions for the leading unknown coefficients 
of strongly divergent perturbation expansions. This can be done by constructing symbolic 
expressions for Pade approximants from the known coefficients of the perturbation series. A 
Taylor expansion of sufficiently high order of such a Pade approximants then produces the 
predictions for the series coefficients which were not used for the construction of the Pade 
approximant. The Taylor expansion of the symbolic expression can be done comparatively 
easily with the help of powerful computer algebra systems like Maple or Mathematica, which 
are now commercially available for a wide range of computers. 

It is the purpose of this article to overcome two principal shortcomings of the approach 
sketched above: Firstly, it is not necessary to rely entirely on the symbolic capabilities of com- 
puters. Instead, it is possible to construct recursive schemes, which either facilitate considerably 
the symbolic tasks computers have to perform, or which permit a straightforward computation 
of the prediction for the leading unknown coefficient. Secondly, it is possible to use instead 



of Pade approximants other sequence transformations, as proposed by Sidi and Levin [S5| and 



Brezinski (18|]. It was shown in [105] that this may lead to more accurate predictions. 

In this article, the prediction properties of Aitken's iterated A 2 process, Wynn's epsilon 
algorithm, and Brezinski's iterated theta algorithm are studied. 

As is well known || ||, a Pade approximant can be considered to be the solution of a 
system of linear equations for the coefficients of its numerator and denominator polynomials. 
If this system of linear equations has a solution, then it is automatically guaranteed that the 
Pade approximant satisfies the accuracy-through-order relationship (|1.6|). In the case of other 
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sequence transformations, the situation is usually much more difficult. They are usually not 
defined as solutions of systems of linear equations, but via (complicated) nonlinear recursive 
schemes. 

Since accuracy-through-order relationships of the type of ( |1.6|) play a very important role 
for the understanding of the prediction properties of sequence transformations, it was necessary 
to derive accuracy-through-order relationships for Aitken's iterated A 2 process, Wynn's ep- 
silon algorithm, and Brezinski's iterated theta algorithm on the basis of their defining recursive 
schemes. 



Unfortunately, the defining recursive schemes (|2.4j) , (|3.1|) , and fl4.3|) are not suited for a con- 
struction of accuracy-through-order relationships. They first had to be modified appropriately, 
yielding the mathematically equivalent recursive schemes (|2~ll ), Q, and (PH) . 

These alternative recursive schemes were the starting point for the derivation of the accuracy- 
through-order relationships (2.13), ( |3.9| ), and ( [4.13 ) and the corresponding recursive schemes 
( 2.14j ), (|3.9| ), and ( 4.14 ) for the transformation error terms. These relationships describe how 



and ^ differ from the function f(z) which is to be 



the rational approximants A k , c 2/ . . 
approximated. 

With the help of these accuracy-through-order relationships, a second group of results could 
be derived - ( [2.19| ), ( |3.14| ), and ( [4.18| ) and the corresponding recursive schemes ( ^20|) , (|1J|), 
and (4.19) - which describe how the rational approximants «4.[ , e^L , and J'S n ' differ from the 
partial sums which were used for their construction. These differences are expressed by the terms 



z n + 2k+1 <p$(z) 



and z n+zk+1 ^f'{z) which can be computed via the recursive 
schemes ( p0| ), ( |3~T5| ), and ( fD| ). 

The predictions for the leading unknown series coefficients can be obtained by expanding 
symbolic expressions for these transformation terms. The advantage of this approach is that the 
partial sums, which are used for the construction of the rational approximants Au 



(n) » 



J7jf as well as of the transformation terms /2 n + 2fc + 1 <i>[ n ^( 



e 2k , and 



{z), and z n+3k+1 ^ ( k n) {z), 



are already explicitly separated. Consequently, only derivatives of low order have to be com- 
puted. Moreover, the predictions for the leading unknown series coefficient can be computed 
conveniently via the recursive schemes ( [2.23 ), ( |3,17| ), and (4.21). In this way, it is neither 
necessary to construct symbolic expressions nor to differentiate them. 

Finally, in Section [5] some applications of the new results were presented. In all applications 
of this article, Wynn's epsilon algorithm was found to be less effective than Aitken's iterated 
A 2 process or Brezinski's iterated theta algorithm. Of course, it remains to be seen whether 
this observation is specific for the infinite series (|5.2| ) for ln(l + z)/z, which was used as the 
test system, or whether it is actually more generally valid. Nevertheless, the results presented 
in Section || provide further evidence that suitably chosen sequence transformations may indeed 
be more effective than Pade approximants. Consequently, one should not assume that Pade 
approximants produce by default the best results in convergence acceleration and summation 
processes, and it may well be worth while to investigate whether sequence transformations can 
be found which are better adapted to the problem under consideration. 
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